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Structure detection is a procedure for selecting a subset of candidate terms, from a full model description, 
that best describes the observed output. This is a necessary procedure to compute an efficient system de- 
scription which may afford greater insight into the functionality of the system or a simpler controller design. 
Structure computation as a tool for black-box modelling may be of critical importance in the development 
of robust, parsimonious models for the flight-test community. Moreover, this approach may lead to efficient 
strategies for rapid envelope expansion which may save significant development time and costs. 

In this study, a least absolute shrinkage and selection operator (LASSO) technique is investigated for com- 
puting efficient model descriptions of nonlinear aeroelastic systems. The LASSO minimises the residual sum 
of squares by the addition of an i\ penalty term on the parameter vector of the traditional li minimisation 
problem. Its use for structure detection is a natural extension of this constrained minimisation approach to 
pseudolinear regression problems which produces some model parameters that are exactly zero and, therefore, 
yields a parsimonious system description. Applicability of this technique for model structure computation for 
the F/A-18 Active Aeroelastic Wing using flight test data is shown for several flight conditions (Mach numbers) 
by identifying a parsimonious system description with a high percent fit for cross-validated data. 

I. Introduction 

S YSTEM identification, or black-box modelling, is a critical step in aircraft development, analysis and validation for 
flight worthiness. The development and testing of aircraft typically takes many years and requires considerable 
expenditure of limited resources. One reason for lengthy development time/costs is inadequate knowledge of an 
appropriate model type or structure to use for parameter estimation. Selection of an insufficient model structure may 
lead to difficulties in parameter estimation, giving estimates with significant biases and/or large variances. * 1 * This often 
complicates control synthesis or renders it infeasible. The power of using structure detection techniques as a tool for 
model development (i.e. black-box modelling) is that it can provide a parsimonious system description which can 
describe complex aeroelastic behaviour over a large operating range. Consequently, this provides models that can be 
more robust and, therefore, reduce development time. 

Moreover, when studying aeroelastic systems it may not be practical to assume that the exact model structure 
is well known a priori. In aerospace systems analysis one of the main objectives is not only to estimate system 
parameters but to gain insight into the structure of the underlying system. Therefore, structure computation is of 
significant relevance and importance to modelling & design of aircraft and aerospace vehicles. Structure computation 
may indicate deficiencies in an analytical model and could lead to improved modelling strategies and also provide a 
parsimonious, black-box, system description for control synthesis.® 

II. NARMAX Model Form 

Recently, Kukreja and Brenner 5 ' showed that NARMAX (Nonlinear AutoRegressive, Moving Average exogenous) 
identification is well suited to describing aeroelastic phenomena. The NARMAX structure is a general parametric 
form for modeling nonlinear systems? 4 This structure describes both the stochastic and deterministic components of 
nonlinear systems. Many nonlinear systems are a special case of the general NARMAX structure. 5 In this paper, we 
focus on a special class of NARMAX models; nonlinear polynomial models. The polynomial NARMAX structure 
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models the input-output relationship as a nonlinear difference equation of the form 

z(n) — f l [z(n 1 ) , • • • ,z(n-n y ),u(n),--- ,u(n-n u ),e(n- l),--- ,e(n-n e )\ +e(n). (1) 

/ denotes a nonlinear mapping, Z is the order of the nonlinearity, u is the controlled or exogenous input, z is the 
measured output, and e is the uncontrolled input or innovation. This nonlinear mapping may include a variety of 
nonlinear terms, such as terms raised to an integer power, products of present and past inputs, past outputs, or cross- 
terms. In general, the nonlinear mapping, /, can be described by a wide variety of nonlinear functions such as sigmoids 
or splines. 6 5 This system description encompasses many forms of nonlinear difference equations that are linear-in- 
the-parameters. 

Identifying a NARMAX model requires two things: (1) structure detection and (2) parameter estimation. Structure 
detection can be divided into: (la) model order selection and (lb) selecting which parameters to include in the model. 
We consider model order selection as part of structure detection since, theoretically, there are an infinite number of 
candidate terms that could be considered initially. Establishing the model order, then, limits the choice of terms to be 
considered. For the NARMAX model, the system order is defined to be an ordered tuple as 

0=\n u n z n e l\ (2) 

where n u is the maximum lag on the input, n z the maximum lag on the output, n e the maximum lag on the error and / 
is the maximum nonlinearity order. Note that for non-polynomial NARMAX models, / may be simply replaced by a 
nonlinear mapping of some specified class. In this paper, we assume that the system order is known. 


III. Structure Detection 


The structure detection problem is that of selecting the subset of candidate terms that best describes the output. 
Therefore, the parametrisation of a system is still further reduced by determining which of the components are required. 
The maximum number of terms in a NARMAX model with n z , n„ and n e dynamic terms and Zth order nonlinearity is: 


/ 

P= £pi+ 1; p; 

Z=1 


Pi-i(n u + n z + n e + i) 
; ,P o=l 

l 


(3) 


As a result, the number of candidate terms becomes very large for even moderately complex models making structure 
detection difficult. We define the maximum number of terms, p, as the number of candidate terms to be initially con- 
sidered for identification. Due to the excessive parameterisation (the curse of dimensionality), the structure detection 
problem often leads to computationally intractable combinatorial optimisation problems. 


IV. LASSO 

Recently, Kukreja et all developed a novel approach to this computationally intractable combinatorial optimisation 
problem. The least absolute shrinkage and selection operator (LASSO) 8 is least-squares like problem with the addition 
of an l\ penalty on the parameter vector as 

mini || (Z - <50) ||2 + A ||0 IK (4) 

where ||-||2 denotes the f^-norm, ||-||i denotes the £i-norm, Z £ R A?xl is a vector of outputs, <P £ R Nx p is a matrix 
of regressors and 9 £ M px 1 is a vector of unknown system coefficients. Note that the regression matrix is a function 
of the measured input-outputs and unmeasured noise, which makes this a pseudolinear regression problem since <f> is 
(partly) unknown and must be estimated along with the parameters. 

The regularisation parameter K 9 A = [A m ,„ ..... k max \ controls the trade-off between approximation error and 
sparseness. LASSO shrinks the least-squares estimator (RHS Eqn. [4]) towards 0 and potentially sets 9j = 0 for some 
j. Consequently, LASSO behaves as a structure selection instrument. 

Structure detection can provide useful process insights that can be used in subsequent development or refinement 
of physical models. Therefore, in the sequel, we investigate the applicability of LASSO to experimental aircraft data. 
Specifically, LASSO is used as a structure detection tool to assess whether the (i) underlying data is best described by 
a linear time-invariant (LTI) or nonlinear model and (ii) model structure is invariant during envelope expansion. 
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V. Experimental Aircraft Data 


The LASSO technique was assessed on experimental flight test data from the F/A-18 AAW project at NASA 
Dryden Flight Research Center. The data analysed for this study used collective aileron position input and structural 
accelerometer response output. 

A. Procedures 

Flight data was gathered during subsonic flutter clearance of the AAW. At each flight condition, the aircraft was sub- 
jected to band-limited white inputs, with uniform distribution and zero-mean. The inputs correspond to collective and 
differential aileron, collective and differential outboard leading edge flap, rudder, and collective stabilator excitations 
in the range of ±0.5 rad and 30 Hz bandwidth for 26 sec. 

This paper considers accelerometer data measured during the collective aileron sweeps at Mach 0.85 and 0.95 both 
at 4,572 m (15,000 ft). The output was taken as the response of an accelerometer mounted near the wing leading edge 
just outside the wing fold (see Fig. [T}. Data was sampled at 400 Hz. For analysis, the recorded flight test data was 



Figure 1. AAW accelerometer locations 

decimated by a factor of 4, resulting in a final sampling rate of 100 Hz. 

For identification the model posed for structure computation was an additive nonlinear model of the form 

q r 

z(n) = £ 0 v (p(n)+ £ 9 w f((p(n)) +e(n)\ q + r=p. (5) 

V=1 W = 1 

The regressors posed for this identification problem were of the form given in Eqn. |T] up to lag order 4, and the 
nonlinear mapping /(•), was chosen to be a hyperbolic tangent function (tanh(-)); O = [4 4 4 tanh]. It has been 
observed that aeroelastic structures present a well defined low frequency elastic mode composition. 9 10 Therefore, the 
modal components are represented using a fourth-order dynamic expansion. 1 1 Typically, an assumption is made that 
a structural nonlinearity exists in an aeroelastic system that affects not only flutter speed, but also the characteristics 
of the motion. 12 I j An example of an aeroelastic nonlinearity is a preloaded spring tab system. It has been proposed 
that this type of nonlinearity be modelled as a saturator. 13 In this paper, we chose to model this type of nonlinearity 
as a hyperbolic tangent, tanh(-), because a wing section response typically saturates smoothly. This gave a full model 
description with 27 candidate terms. 

The system was identified using scaled hyperbolic tangent functions because the input amplitude is less than ±1 
(see Fig[2ji. The scale factors used for the input, output and error signals were in the range of v = [0.1 1.0] and 
increased in increments of 0.1. A scaled hyperbolic tangent is denoted as tanh(-,v). Models with every possible 
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combination of scale factors were considered (i.e. structure computation was performed on 1,000 models). The model 
which yielded the highest cross-validation percent fit was deemed the best-fit model. 

The system was identified applying the LASSO approach. For estimation, N e = 2,570 points were used from 
accelerometer response measurements on the left wing. For cross-validation, N v = 2,570 points were used from data 
collected at a similar location on the right wing. In both the estimation and cross-validation sets, the input was the 
same collective aileron position. The min-max regularisation parameter levels were set to A„„„ = — 10 and X„ mx = 0.5 
( 10 *™" < A < 10 *"'“) with a discretisation grid of 1,000 logarithmically spaced A’s. 

B. Results 

The results of identifying the AAW data are presented. Fig.[2]shows the input-output trials used for this analysis. The 
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(a) Mach 0.85, Alt. 4,572 m (15,000 ft) 


(b) Mach 0.95, Alt. 4,572 m (15,000 ft) 


Figure 2. Estimation data. Upper panel: Recorded collective aileron position. Lower panel: Recorded structural accelerometer response. 

data represents collective aileron position sequence and structural accelerometer response (left wing) used to compute 
the system structure. 

Eqns.[6]&[7] depict the model structure computed by the LASSO method 

z(n) = 0o + Q\u(n — 1) + § 2 u(n — 4) + 63 tanh(w(n — 1),0.4) + 64 tanh(M(« — 2), 0.4) (6) 

+ 0 5 tanh(w(« — 3), 0.4) + 0 6 z(« — 1) + 0yz(n — 2) + 9%z(n — 4) + 0 9 tanh(z(« - 1),0.4) 

+ 0iotanh(z(/i — 3), 0.4) + 0\\£(n— 1) + 0ne{n — 2) + 0 i 3 e(« — 4) + 0 i 4 tanh(e(n — 1) , 0.4) 

+ 0i5tanh(e(7i — 3), 0.4) 

z(n) = t?o + — 1) + ‘& 2 .u{n — 4) $3 tanh(u(/t — 1) , 0.4) + $4 tanh(w(tt — 2) , 0.4) + t? 5 z(n — 1) (7) 

+ $6 z(n — 2) + $7 z(n — 4) + &g tanh (z(n — 1 ) , 0.4) + $9 tanh(z(n — 3) , 0.4) + t?io tanh(z(n — 4) , 0.4) 

+ t?ne(n — 1) + t?i 2 £(n — 2) + t?i 3 e(n — 4) + t>i 4 tanh(e(n — 1),0.4) + $15 tanh(e(u — 3), 0.4) 

+ t?i 6 tanh(e(« — 4), 0.4). 

Eqn.| 6 ]represents the computed model structure for flight condition Mach 0.85 whilst Eqn.[7]represents the computed 
model structure for flight condition Mach 0.95. The computed model structures are represented by a combination 
of linear and nonlinear, lagged input-output terms and contain 15 and 16 terms for Mach 0.85 and 0.95, respectively. 
Hence, the LASSO technique successfully produced a parsimonious model description from the full set of 27 candidate 
terms. 

Fig. [3] shows the predicted output for a cross-validation data set for the identified structure ((a): Eqn.[ 6 ] (b): Eqn. 
|7J. The upper panel displays the full 26s time history of the accelerometer response recorded on the right wing. The 
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Structural Accelerometer Response: Right Wing Structural Accelerometer Response: Right Wing 



Cross-Validated Accelerometer Response (10s slice) Cross-Validated Accelerometer Response (1 1 s slice) 
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(a) Mach 0.85, Alt. 4,572 m (15,000 ft) 


(b) Mach 0.95, Alt. 4,572 m (15,000 ft) 


Figure 3. Cross-validation data. Upper panels: Full time history of structural accelerometer response. Lower panels: Predicted accelerom- 
eter response of right wing superimposed on top of measured accelerometer output. 


lower panel displays a 10 (Mach 0.85) and 11 (Mach 0.95) second slice of the predicted output superimposed on top 
of the measured output. For Mach 0.85 (Fig.[3](a)) the predicted output accounts for over 95% of the measured outputs 
variance whilst for Mach 0.95 (Fig.[3}b)) the predicted output accounts for over 98% of the measured outputs variance. 
The results demonstrate that the computed model structures are capable of reproducing the measured output with high 
accuracy. 


VI. Discussion 

Experimental results demonstrate that structure computation as a tool for black-box modelling may be a useful 
tool for the analysis of dynamic aircraft data. The LASSO successfully reduced the number of regressors posed to 
aircraft aeroelastic data yielding a parsimonious model structure for each data set. Additionally, these parsimonious 
structures were capable of predicting a large portion of the cross-validation data, collected on the adjacent wing and 
with a different sensor. This suggests that the identified structures and parameters explain the data well. Using percent 
fit alone as an indicator of model goodness could lead to incorrect interpretations of model validity. However, in many 
cases, for nonlinear models this may be the only indicator that is readily available. 

In this work, the results show that whilst the linear dynamics remained invariant for both flight conditions available 
for analysis, the nonlinear dynamics changed as Mach number increased. For Mach 0.85 the model (Eqn.[6]) displayed 
a richer nonlinear dynamic description associated with the input, possibly due to actuation stiction. When the Mach 
number was increased to 0.95, with other flight conditions held invariant, the model (Eqn. |7j demonstrated a richer 
nonlinear dynamic description associated with the output, possibly associated with the ailerons. It is difficult to 
make definitive comments on the underlying physics responsible for this behaviour without extensive analysis of 
different flight conditions. The important points to note are, this study suggests (i) nonlinear models are appropriate 
to describe the dynamics behaviour of advanced aircraft and (ii) models describing aircraft dynamics vary with flight 
condition. This suggests nonlinear modelling may afford a robust and parsimonious system description over a larger 
operating regime and models used for prediction (e.g. control) are not invariant for all flight conditions. This may hold 
significant implications for aircraft development, saving time and money. + For this study, only hyperbolic tangent 
with fourth-order input, output and error lag was used as a basis function to explain the nonlinear behaviour of the 
F/A-18 AAW data. Clearly, different basis functions and a higher dynamic order (lag-order) should be investigated to 
determine if another basis can produce accurate model predictions with reduced complexity. Moreover, further studies 
are necessary to evaluate whether the model structure is invariant under different operating conditions, such as altitude. 
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and model parameterisations. 

This study illustrates the usefulness of structure detection as an approach to compute a parsimonious model of a 
highly complex nonlinear process, as demonstrated with experimental data of aircraft aeroelastic dynamics. More- 
over, analysis of input-output data can provide useful process insights that can be used in subsequent development 
or refinement of physical models. In particular, morphological models are based on assumptions (e.g. these effects 
are important and those are negligible) which may be incorrectIHE 15 A structure computation approach to model 
identification may help uncover such surprises. 


VII. Conclusions 

LASSO is a novel approach for detecting the structure of over-parameterised nonlinear models. These results may 
have practical significance in the analysis of aircraft dynamics during envelope expansion and could lead to more 
efficient control strategies. In addition, this technique could allow greater insight into the functionality of various 
systems dynamics, by providing a quantitative model which is easily interpretable. 
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